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Abstract 

A family of real functions {g a } denning a spectral regularization method with optimal qual- 
ification is considered. Sufficient condition on the family and on the optimal qualification guar- 
anteeing the existence of saturation are established. Appropriate characterizations of both the 
saturation function and the saturation set are found and some examples are provided. 
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1 Introduction 

Let X, Y be infinite dimensional Hilbert spaces and T : X — ¥ Y a bounded linear operator with non- 
closed range TZ(T). It is well known that under these conditions the Moore- Penrose generalized 
inverse of T, is unbounded (PQ) and therefore the linear operator equation 

Tx = y (1) 

is ill-posed. The Moore- Penrose generalized inverse can be used to define the least squares solutions 
of ([T]). In fact equation ([T]) has a least squares solution if and only if y G V{T^) = TZ(T) © ^(T) 1 - 
and in that case, x^ = T^y is the least squares solution of minimum norm and the set of all 
least-squares solutions of ([I]) is given by x*+J\f(T). Since is unbounded, does not depend 
continuously on the data y. Therefore, if instead of the exact data y, a noisy observation y s is 
available, y s = Tx + 5£, where the noise £ is assumed to be bounded, ||£|| < 1, then it is possible 
that T^y s does not even exist and if it does, it will not necessarily be a good approximation of x^ 
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([9]) [10j ) ■ This instability becomes evident when trying to approximate by traditional numerical 
methods and procedures. 

Ill-posed problems must be first regularized if one wants to successfully attack the task of 
numerically approximating their solutions. Regularizing an ill-posed problem such as ([I]) essentially 
means approximating the operator T^ by a parametric family of bounded operators {R a }, where 
a is the so called "regularization parameter". If y G T>(T^), then the best approximate solution 

set of ([T|) can be written as = /J' T " + j dE\T*y where {E\} is the spectral family associated 
to the operator T*T (see [Tj). This is mainly why many regularization methods are based on 

II T\\ ^ -|- 

spectral theory and consist of defining R a = Jq g a (A) dE\T* where {g a } is a family of functions 
appropriately chosen such that for every A 6 (0, ||T|| 2 ] there holds lim g a (X) = 4. It is important 

to emphasize however that no mathematical trick can make stable a problem that is intrinsically 
unstable. Whatever the case, there is always loss of information. All a regularization method 
can do is to recover the largest possible amount of information about the solution of the problem, 
maintaining stability. It is often said that the art of applying regularization methods consist 
always in maintaining an adequate balance between accuracy and stability. Usually accuracy can 
be improved with increasing assumptions (or information) on the regularity of the exact solution. 
In 1994, however, Neubauer ([7]) showed that certain spectral regularization methods "saturate" , 
that is, they become unable to continue extracting additional information about the exact solution 
even upon increasing regularity assumptions on it. In his article, Neubauer introduced for the 
first time the idea of the concept of "saturation" of regularization methods. Saturation is however 
a rather subtle and complex issue in the study of regularization methods for inverse ill-posed 
problems and the concept has, for many years, escaped rigorous formalization in a general context. 
Neubauer's idea referred to the best order of convergence that a method can achieve independently 
of the smoothness assumptions on the exact solution and on the selection of the parameter choice 
rule. In 1997, Neubauer ([8]) showed that this saturation phenomenon occurs for instance in the 
classical Tikhonov-Phillips method. Later on, in 2004, Mathe ([5j) proposed a general definition of 
the concept of saturation for spectral regularization methods. However, the concept of saturation 
defined by Mathe is not applicable to general regularization methods and it is not fully compatible 
with the original idea of saturation proposed by Neubauer in [TJ. In particular, for instance, the 
definition of saturation given in [5] does not imply uniqueness and therefore, neither a best global 
order of convergence. More recently, in 2011, Herdman, Spies and Temperini (see [3]) developed 
a general theory of global saturation for arbitrary regularization methods, formalizing the original 
and intuitive idea first outlined by Neubauer in 1994 ([TJ). 

Related in a dual way to the concept of saturation is the concept of qualification of a spectral 
regularization method, introduced by Mathe and Pereverzev in 2003 ([6]). This concept is strongly 
related to the optimal order of convergence of the regularization error, under certain "a-priori" 
assumptions on the exact solution. In 2009 Herdman, Spies and Temperini ([2]) generalized the 
concept of qualification and introduced three hierarchical levels of it: weak, strong and optimal 
qualification. There, it was shown that the weak qualification generalizes the definition introduced 
in ©. 

In this work, some light on the existence of saturation for spectral regularization methods with 
optimal qualification is shed. In particular, sufficient conditions on the family of real functions 
{g a } defining the method and on the optimal qualification p, which guarantee the existence of 
saturation, are established. Moreover, in those cases, appropriate characterizations of both the 
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saturation function and the saturation set are provided. 



2 Preliminaries 

In this section we shall recall some basic concepts on global saturation of regularization methods 
for inverse ill-posed problems theory (for more details see [3]). In the sequel, T : X — > Y will be a 
bounded linear operator with non-closed range between two Hilbert spaces X and Y. Without loss 
of generality we will assume that the operator T is invertible (in the context of inverse problems it 
is customary to work with the Moore-Penrose generalized inverse of T since one seeks least squares 
solutions of the problems; therefore the lack of injectivity of T is never a relevant issue). Also, for 
simplicity of notation and unless otherwise specified, we shall assume that all subsets of the Hilbert 
space X under consideration are not empty and they do not contain x = 0. 

Let M C X. We shall say that a function ip : X x IR — > IR belongs to the class J~m if there 
exists a = a(ifj) > such that ip is defined in M x (0, a), with values in (0,oo) and it satisfies the 
following conditions: 

1. lim tp{x, 5) = for all x E M, and 

5— >0+ 

2. ip is continuous and non-decreasing as a function of 5 in (0, a) for each fixed x E M. 



One may think of Tm as the collection of all possible 5-" orders of convergence" on the set M, 

Definition 2.1. Let {Ra} a e(o,a ) be a family of regularization operators for the problem Tx = y. 
The "total error of {Ra} a e(o,a ) at x £ X for a noise level 5" is defined as 



£}°*(x,5)= inf sup 



y s eB s (Tx) 



R a y 5 - x 



where B$(Tx) = {y E Y : \\Tx — y\\ < 5}. 



Note that is the error in the sense of the largest possible discrepancy that can be ob- 

tained for an observation of y within noise level 5, with an appropriate choice of the regularization 
parameter a. 

Definition 2.2. Let M C X and ip,ip E Tyi- We say that "ip precedes ip on M", and we 

M _ 

denote it with if) X ij} 7 if there exist a constant r > and a function p : M — > (0, oo) such that 
ip(x, 5) < p(x) ip(x, 5) for all x E M and for every 5 E (0, r) . 



Definition 2.3. Let {Ra} a e(o,a ) be a family of regularization operators for the problem Tx = y, 
M C X and tp E J~m- We say that ip is an "upper bound of convergence for the total error of 

M 

{Ra}ae(o,«o) onM" if£\f a} <^. 

With Um(£{£ }) we shall denote the set of all functions ij) E Tm that are upper bounds of 
convergence for the total error of {R a } a e(o,a ) on M. 

The following two definitions formalize certain comparisons of bounds of convergence on different 
sets of X, which will be needed later to introduce the concept of global saturation. 



EXISTENCE OF SATURATION FOR SPECTRAL REG ULARIZATION METHODS 



4 



Definition 2.4. Let M, M C X, ip G Tm and ip G J 7 ^. 

M,M _ 

i) We say that "ip on M precedes ip on M", and we denote it with ip ^ ip, if there exist a 
constant d > and a function k : M x M — > (0, oo) such that ip(x,5) < k(x,x)ip(x,5) for every 
xeM,xeMand5e (0,d). 

M,M ~ M,M 

ii) We say that hp on M is equivalent to ip on M", and we denote it with ip ~ ip, if tp < ip 

~ M,M 

and ip> -< ip. 

M,M 

Definition 2.5. Let M C X and ip G F^i- We say that "tp is invariant over M" if tp « ip. 

Next we recall the concept of global saturation introduced in [3] . 

Definition 2.6. Let Ms C X and ips £ Ums(£{r })• ^ * s sa ^ that ips is a "global saturation 
function of {R a } over Ms" if ips satisfies the following three conditions: 

£tot ( x * fi\ 

51. For every x* € X, x* / 0, x £ M s , limsup { * a \ x &) > 0. 

52. ips is invariant over Ms- 

53. There is no upper bound of convergence for the total error of{R a } that is a proper extension 
of ips (i n the variable x ) and satisfies SI and S2, that is, there exist no M ^ Ms and ip G U^(£^ j) 

such that ip satisfies SI and S2 with Ms replaced by M and ips replaced by ip. 

The function ips and the set Ms are refer to as the saturation function and the saturation set, 
respectively. 

This conception of global saturation essentially establishes that in no point x* 6 X, x* ^ 0, 
can exist an upper bound of convergence for the total error of the regularization method that is 
"strictly better" than the saturation function ips at any point of the saturation set Ms- 

Let {-EaIasir be the spectral family associated to the linear selfadjoint operator T*T and 
{9a}a£(o,a ) a parametric family of functions g a : [0, ||T|| 2 ] — )■ JR, a G (0,o.q), and consider the 
following standing hypotheses: 

HI. For every a £ (0, Qo) the function g a is piecewise continuous on [0, ||T|| 2 ]. 

H2. There exists a constant C > (independent of a) such that |A<? a (A)| < C for every 
A G [0, ||T|| 2 ]. 

H3. For every A G (0, ||T|| 2 ], there exists lim g a (\) = j. 

a— >0 + 

If {g a }a£(o,a ) satisfies hypotheses H1-H3, then (see [I], Theorem 4.1) the collection of operators 
{i?a}ae(o,ao)> where 

r\\T\\ 2 + 

R a = / 9a (A) dE x T* = g a (T*T)T*, 
Jo 

is a family of regularization operators for In this case we say that {R a }a&(o,a ) is a "family of 
spectral regularization operators" (FSRO) for Tx = y and {g a }ae(o,a ) is a "spectral regularization 
method" (SRM). 

The following definitions will be needed both to recall the concept of qualification as introduced 
in [2], as well as in the rest of the article. 
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We denote with O the set of all non-decreasing functions p : IR + —> IR + such that lim p(a) = 

a-s>0+ 

and with S the set of all continuous functions s : ]R,| — > IR^ satisfying s(0) =0 and such that 
s(A) > for every A > 0. Note that if s £ 5 is non-decreasing, then s is an index function in the 
sense of Mathe-Pereverzev ([6]). 

Definition 2.7. Let p,p £ C We say i/tai "p precedes p at the origin" and we denote it with 
P ^ p, if there exist positive constants c and e such that pipe) < c /5(a) for every a £ (0, e) . 

Definition 2.8. Let p,p £ 0. We say that "p and p are equivalent at the origin" and we denote 
it with p ~ p, if they precede each other at the origin, that is, if there exist constants e > 0, c%, ci, 
< ci < C2 < oo such that c\ p{a) < p(a) < C2 p{a) for every a £ (0, e). 

Clearly "~" is an equivalence relation and it introduces in O a partial ordering. Analogous 
definitions and notation will be used for s,s £ S. 

Definition 2.9. Let {g a } a e(o,a ) be a SRM, r a (X) = 1 — Xg a (X), p £ O and s £ S. 

i) We say that (s,p) is a "weak source-order pair for {g a }" if it satisfies 

s(A)|r a (A)| for a^0 + ,\/X>0. (2) 

p(a) 

ii) We say that (s,p) is a "strong source-order pair for {g a } " if it is a weak source- order pair 
and there is no X > for which "0(1) " in (U|) can be replaced by "o(l) ". That is, if (s, p) is a weak 
source- order pair for {g a } an d 

hmsup S(A) ' r " (A)l >0 VA>0. (3) 

Hi) We say that (p,s) is an "order-source pair for {g a }" if there exist a constant 7 > and a 
function h : (0, ckq) — > IR + with lim h(a) = 0, such that 



a->-0H 

s(X)\r a (X)\ 
p(a) 



> 7 V A £ [h(a), +00). (4) 



In the context of the previous definitions we refer to the function p as the "order of convergence" 
and to s as the "source function" . 

We are now ready to define the concept of qualification in its three different levels as it was 
introduced in [2]. 

Definition 2.10. Let {g a } be a SRM. 

i) We say that p is "weak qualification of{g a }" if there exists a function s such that (s,p) is a 
weak source-order pair for {g a }- 

ii) We say that p is "strong qualification of {g a }" if there exists a function s such that (s,p) is 
a strong source-order pair for {g a }- 

Hi) We say that p is "optimal qualification of{g a }" if there exists a function s such that (s,p) 
is a strong source-order pair for {g a } and (p,s) is an order-source pair for {g a }. 
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Note that since condition (JH) implies condition ([3]), in the definition of optimal qualification 
above the requirement that (s, p) be strong source-order pair can be replaced by the one that (s, p) 
be a weak source-order pair. 

Now given the SRM {g a } and p G O, we define 

sJX) =liminf-^- for A > 0. (5) 
a^>-0+ \r a {A)\ 

Note that s p (0) = and if s p is continuous, s p G S. 

The next theorem provides necessary and sufficient condition, in terms of s p , for an order of 
convergence p G O to be optimal qualification. 

Theorem 2.11. (f^) Let {g a } be a SRM and p G O such that s p G S. Then p is optimal 
qualification of {g a } if and only if s p verifies dH) and 

< s p (A) < +oo for every A > 0. (6) 

The next theorem shows the uniqueness of the source function. 

Theorem 2.12. flE/) If p is optimal qualification of {g a } then there exists only one function s (in 
the sense of the equivalence classes induced by Definition \2. 8\) such that (s,p) is a strong source- 
order pair and (p, s) is an order-source pair for {g a }. Moreover if s p G S, then s p is such a unique 
function. 

The following converse result, where regularity properties of the exact solution are derived in 
terms of the rate of convergence of the regularization error, will be needed later. This result states 
that if the regularization error has order of convergence p{a) and (p, s) is an order-source pair, then 
the exact solution belongs to the source set given by the range of the operator s(T*T). 

Theorem 2.13. ([2]) Let {g a } be a SRM and R a = g a (T*T)T* . If \\{R a - T^)y\\ = 0(p(a)) for 
a — > + and (p,s) is an order-source pair for {g a } ; then T^y G lZ(s(T*T)). 



3 Saturation of spectral regularization methods with optimal qual- 
ification 

The purpose of this section is to shed some light on the saturation of SRM with optimal qualification. 
More precisely, we will establish sufficient conditions on the family of functions {<?a} and on the 
optimal qualification p guaranteeing the existence of saturation. Moreover, for those methods we 
will provide appropriate characterizations of both the saturation function and the saturation set. 
Then, let {g a }a£(o,a ) he a SRM and consider the following hypothesis: 
R~4. Exists k > such that G a = HffaOHoo <^Va£ (0,a ). 

Lemma 3.1. Let {g a } a ^(o,a ) be a SRM satisfying hypothesis H~4, R a = g a (T*T)T* and (s,p) 
a weak source-order pair for {g a } a &(o,a ) where p is continuous. Define X s = TZ(s(T*T)) \ {0}, 
Q(t) = y/ip(t) fort > 0, ip(x,6) = poQ- l (5) forx G X s and 5 G (0,G(a o ))- Then ip G T X ° and, 
moreover, tp is an upper bound of convergence for the total error of {R a } a e(o a ) on X s , that is, 
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Proof. Since p is continuous and non-decreasing and p(0 + ) = it follows that 0(i) is continuous and 
strictly increasing on (0, +oo) with 0(O + ) = 0. Therefore O -1 exists and has the same properties. 
It then follows that ip is continuous and non-decreasing as a function of 5 in (0, 0(ao)) for each 
fixed x G X s , and ^(x,0 + ) = for all x G X s . Hence ip G Tx s - 

On the other hand, since (s,p) is a weak source-order pair for {g a } a e(o,a )i there exist positive 
constants c and a such that s(A) |r a (A)| < cp(a) for every a G (0, a), A G (0, ||T|| 2 ]. Moreover, from 
hypothesis H2 and the fact that p is non-decreasing it follows that the previous inequality holds 
(perhaps with a different positive constant c) for every a G (0,ao), that is, 

|2i 



s(A)|r Q (A)| <cp(a) VaG (0,a ),VAG (0, ||T| 



(7) 



Now, for every p > we define the source sets = {x G X : cc = s(T*T)(, ||£|| < p}. 

Then for each x G X s there exists p x > 1 such that x G X s ' Px . On the other hand, since O is 
continuous and strictly increasing in (0, ccq), there exists a unique d x G (0, ao) such that a; G 
and 0(a x .) 



— . Therefore, 

Px ' 



inf 

ae(0,a ) ,,S 



sup 



< 



sup 



y"eB s (Tx) 



R a y d 



y A eB s (Tx) 



Now, since y s = Tx + ££, ||^|| < 1 and x = s(T*T)( with < p x ., it follows immediately that 



X 



< || (g &x (r*T)T*T - I)s(T*T)£\\ + 6 \\g &x (T*T)T*£\\ 

< p x sup {s(X)\r &x (X)\} + 5 sup {V\\ga x (X)\}, 

Ae(0,||T|| 2 ] Ae(0,||T|| 2 ] 



(8) 



where the last inequality follows from properties of functions of a selfadjoint operator, (more pre- 
cisely, for any piecewise continuous function / there holds ||/(T*T)|| < sup|/(A)| and \\f(T*T)T*\\ < 



sup{VA |/(A)|}, see [T], p. 45). Using flTJ) and hypothesis H4 in (jSJ) it follows that 

A 



< p x cp(a x ) + 5 



k 



(9) 



Since Q(a x ) 



p{a x ) = j-, it follows that 



R& x y b 



X 



- p x p(a x ). Hence by virtue of ([9]) one has that 

< p x (c + k\\T\\)p(a x ) 

< pAc + kWTWMe-Hs)), (10) 



where the last inequality follows from the fact that p x > 1 and both p and 1 are non-decreasing 
functions. From ([8]) and (|10p it follows that for every 5 G (0, 0(ao)), 



£l°£ a} (x, 5) < Px (c + k \\T\\)p(Q-\5)) = Px {c + k \\T\\)^(x, 5) 



This proves that tp G Ux» (£ 



□ 
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Definition 3.2. (141) Let k be a positive constant and p : (0, k] —> (0, +oo) a continuous non- 
decreasing function such that lim pit) = 0. We say that p is of local upper type (3 ((5 > 0) if there 

exists a positive constant d such that p(t) < ds~^p(st) for every s£ (0,1], t G (0, k]. 

Theorem 3.3. (Saturation for FSRO with optimal qualification.) Let {ga}ae(0,ao) ^ e a SRM sat- 
isfying hypothesis R~4 and having optimal qualification p, r a {\) = 1 — \g a (X), R a = g a (T*T)T* and 
suppose that s p £ S (where s p is as defined in (0) ). Assume further that the following hypotheses 
hold: 

a) The function p is of local upper type f3, for some f3 > 0. 

b) There exist positive constants 71,72, A*, c\, with A* < ||T|| 2 and c\ > 1 such that 

i) < r Q (A) < 1, for a > 0, < A < A*; 

ii) r a(A) > 71, for < A < h(a) < A*, a G (0, ao) where h is as in Q). (Note that by virtue 
of Theorem \2.12\ and the fact that s p G S, there exists only one function s £ S satisfying Q), that 
is, s = s p .) 

Hi) |r a (A)| is non- decreasing with respect to a for each A G (0, ||T|| 2 ]; 

iv) g a {c\a) > ^ for < c\a < A* and 

v) fc(A) > g a (\), for < a < A < A < A*. 

c) There exist {A n }^ =1 C o~(TT*) and c > 1 such that A n J, and < c for every n G IN. 

lei B(i) = for t > and X s " = K{s p (T*T)) \ {0}. T/ien ifotf) = p o Qr\S) for 

x G X 5 '' and 5 G (0,6(ao)), is saturation function of {Ra} a &(o,a ) 071 X Sp . 

To prove this theorem we will need three previous lemmas. The first one is a somewhat technical 
result, the second one deals with the existence of an a-priori parameter choice rule leading to a 
worst total error having an appropriate order of convergence, while the third one is a converse 
result. 

Lemma 3.4. Let {g a } a e(o,a ) be a SRM, (p, s) an order-source pair for {g a } and suppose hypothesis 
b.ii) of Theorem \3.3\ holds. Then for every a G (0,ao) the operator r a (T*T) is invertible. 

Proof. Let {E\} be the spectral family of T*T. It suffices to show that for every a G (0, ao), x G X, 
the function r~ 2 (A) is integrable with respect to the measure d \\E\x\\ 2 . Let a G (0, ao) fixed. Since 
(/?, s) is an order-source pair for {g a }, there exist a constant 7 > and a function h : (0, ao) — > IR + 
with lim h{a) = such that 

g(A) h (A) ' >7 VA€[Ma),+oo). 

Therefore 

J h(a) 'a\'V / r l"/ J h[a) 1 H V-*-) 

Now, since a G (0, ao), it follows from hypothesis b.ii) of Theorem 13.31 that r a (\) > 71 > for 
every A G [0,h(a)). Then 

^ , _L. <i||Erf <W! <+00 . (12) 
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From (dTJ and flEJ it follows that Jq T ^ + r~ 2 (X) d\\E x x\\ 2 < +00. Hence r a (T*T) is invertible. 

□ 



Lemma 3.5. Let {g a } be a SRM, R a = g a (T*T)T* , (p, s) an order-source pair for {g a } and assume 
that hypotheses b.ii) and b.iii) of Theorem 1 3. 3\ hold. Let <p : (0, +00) — > IR + be a continuous, non- 
decreasing function satisfying lim ip{6) = and x* G X, x* 7^ 0. 

5— s>0+ 



I) If y(x*,5) = o((p(5)) for 5 — > + , then there exists an a-priori parameter choice rule a(5) 
such that 

■■o(cp{8)) for 5^0 + . 



sup 



II) Part I) remains true with o((p(5)) replaced by 0((p(5)), that is, if y(x*,5) = 0(ip(5)) for 
5 — > + , then there exists an a-priori parameter choice rule a(5) such that 



sup 

y s &B s (Tx*) 



Ra(5)V S -x* = 0(<p(6)) for 6^0+. 



Proof. Let tp and x* G X be as in the hypotheses and suppose that £^ a y(x*,5) = o((p(5)) for 



5 ->0 + . Then by definition of fgj^, 



inf sup I J R a y s — x* || sup ||i? a y 5 — x* || 

,. Qg(0 ' Qo) . ^£Bgrg) 

lim -— = hm mi — = 0. (13) 

.5^0+ <p(o) <5->0+ ae(0,a ) 99(d) 



For the sake of simplicity we define: 



sup — x* || 
f(a,S) = - &Bs{Tx } and q(<5) = inf f(a,5), 

ip{6) ae(0,ao) 

so that with this notation (|13p can be written simply as lim q(5) = and the objective is to 

S— >0+ 

prove the existence of an a-priori parameter choice rule a(5) such that lim f(a(5),5) = 0. It can 

be easily proved that if for certain 5o > 0, £^ y(x*,So) = then = 0. Hence q(5) > for 
every 5 G (0, +00). Also, q(S) is continuous for 6 G (0, +00) since both y(x*,S) and <p(5) are 
continuous. Next, for n G IN we define 

8 n = sup id > : q(S) < - V5 G (0,d) 
[ n 

Clearly, S n J, and since (7 is continuous for every n G IN and every 5 G (0, <5 n ], g(<5) = inf f(a, 5) < 

ae(0,ao) 

— . Then, there exists a n = a n (5 n ) G (0, ao) such that for all n G IN 

/(<*„,£)<- V<5G(0,5 n ]. (14) 
n 
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Now, since {a n } C (0, ckq) is a bounded sequence, there exist a* G [0, ao] and {a nfe } C {a n } such 
that lim a„ fe = i 

k— >+oo 

for <5 > <5 rai . Then 



that lim a„ fe = a*. We now define a(5) = a rafc for 5 G (<5n fe+:L j <5nJ ; fc = 1, 2, and d(<5) = d(<5 ni 

A:— >+oo " 



lim d(<5) = a* 
5^0+ 



(15) 



and 



< lim sup /(a (5), S) < lim sup 

<5— 5>0+ fc— !.+oo 



sup f(a nk ,5) 



< lim sup — = 0, 

k— >+oo ^fc 



where the last inequality follows from (|14|) . 
Hence, 



lim f(a(6),6) = 0. 



(16) 



It remains to be shown that a(5) is an admissible parameter choice rule, for which it suffices to 

prove that lim a(S) = 0, i.e. that a* = 0. If a* > 0, it follows from (|15|) that there exists 5q > 

5— s>0+ 

such that d(<5) > ^- for all <!> G (0, 5q). Hypothesis fa.mj of Theorem 13.31 then implies that for every 



<*e(0,5 ), |r a(5) (A)| > 



r^(A) 



for all A G (0, ||T|| 2 ]. Therefore for every 5 G (0, 5o), 

•||t|| 2 + 



o 



ri {s) (X) d\\E x x* 



> 



" T " + r|»(A)d||£ A x*| 

2 

rg*(T*T)x* " 



(17) 



Now, for all (5 G (0,<5 ), 



sup 



y s £B s (Tx*) 



R a(8)V ~ x * 



> 



\ra(8)(T*T)x* 



> 



~ 9a{8) (T*T)T*T) X* 
r sl (T*T)x* 



where the last inequality follows from (|17p . Dividing through by (f(S), taking limit for 5 — > + , and 



(T*T)x* 



0. Now since %- < ato, 



using the definition of f(a,S) and (fT6|) we conclude that 
(p, s) is an order-source pair for {g a } and hypothesis b.ii) of Theorem 13.31 holds, it follows from 
Lemma [331 that r^* (T*T) is invertible. Therefore x* = 0, contradicting the hypothesis that x* ^ 0. 

2 

Hence, a* must be equal to zero, as wanted. 

We proceed now to prove the second part of the Lemma. Suppose that there exists x* G X, 
x* / such that £^^(x*,5) = 0(ip(5)) as 6 — > + . Then there exist positive constants k and 
d such that inf f(a,5) < k for every 5 G (0,d), where f(a,5) is as previously defined. Let 

c*e(0,ao) 

{J n } ng ]N C (0, d) be such that S n 1 and a n = a ra (<5 n ) G (0, «o) such that 

/(q„,(5) < £; + <5 n , V5 G (0,d), Vn G IN. 

Without loss of generality we assume that the sequence {a n } converges (since if that is not the case, 
we can take a subsequence which does). Now, like in the previously case, by defining a(5) = a n for 
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5 G (5 n +i, S n ], n = 1, 2, and d(e)) = a(S±) for 5 > 5\, since i5 n 4- it follows that /(d(<5), 5) < k+5\ 
for every 5 G (0, d) and therefore 



sup 



y«eB s (Tx*) 



0{ip{5)) as 5^0 + . 



Following the same steps as in the proof of Part I we obtain that lim a(5) = 0, i.e. a(5) is an 

5^0+ 

admissible parameter choice rule. This concludes the proof of the lemma. □ 



Lemma 3.6. Let {g a } a e(o,a ) be a SRM, r a (A) = 1 — \g a (X), R a = g a (T*T)T* , (p,s) an order- 
source pair for {g a }, ©(£) = y/ip(t) for t > 0, and suppose that: 

a) The function p is of local upper type f3, for some f3 > 0. 

b) There exist positive constants 7i,72,A*,ci, with A* < ||T|| 2 and c\ > 1 such that 

i) < r a (X) < 1, for a > 0, < A < A*; 

ii) r Q (A) > 71, for < A < h(a) < A*, a G (0, ao) where h is as in Q); 

|rQ,(A)| is non- decreasing with respect to a for each A G (0, ||T|| 2 ]; 
zuj 5a(cia) > -jf- /or < cia < A* and 
v) fc(A) > 5a (A), /or < a < A < A < A*. 

c) There exist {A n }^ =1 C o~(TT*) and c > 1 suc/i i/iai A n J, and ^ n < c /or every n G IN. 
If for some x £ X we have that 



sup 



y s eB s (Tx) 



inf 

ae(0,oo) 



(18) 



then x G TZ(s(T*T)). In particular, if p is optimal qualification of {g a } and s p G S, then x G 
1l(s p (T*T)). 



Proof. Without loss of generality we may assume that ao < ^- and x ^ (this is so because 
hypotheses a) and c) are independent of ao and if b) holds for a G (0,ao) then it holds for 
a G (0, do) for every do < «o with the same constants, while if x = the result of the Lemma is 
trivial) . 

Let a G a(TT*) be such that < c\ a < ao (hypothesis c) guarantees the existence of such a), 
and define 

- - a 1 / 2 a 1 / 2 

5 = 5(a) = \\RqTx — x\\ = ||rQ,(T*T)3;|| . 

72 72 

Then, clearly the equation 

\\R a Tx-xf = &I? (19) 
a 

in the unknown a, has a = a as a solution. Moreover, since \\R a Tx - x\\ 2 = J I|T||2+ r 2 (A) d \\E x xf 
and x 7^ 0, hypotheses b.ii) and b.iii) imply that the function p(a) = a \\R a Tx — x\\ 2 is strictly 
increasing for a in (0, ao). Hence, a = a = r/(5) (where r](5) = /^ _1 (o~) ) is the unique solution of 
(|19p . Note that if a — > + then J — >• + . Moreover, by hypothesis b.iii) and Lemma 13.41 it follows 
immediately by Fatou's Lemma that 5 — > + only if a — > + . 
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Now, for 5 > define 

y 5 = Tx-5G a z, (20) 
where G a = F Cia — F a with {F\} being the spectral family associated to TT* and 

\\GqTx\\~ 1 Tx, if GqTx ^ 0, 

arbitrary with ||Gqz|| = 1, in other case. 

Note that since a G a(TT*) and ci > 1 it follows that Ga is not the null operator and therefore 
the definition makes sense. Note also that \\y s — Tx\\ = 5, which implies that y s G B$(Tx). 

Now, by using ([H and the fact that g a (T*T)T* = T*g a (TT*) it follows that for every a G 
(0, ao) and 5 > 0, 

(R a Tx - x , R a (y s - Tx)) = {g a (T*T)T*Tx - x, —g a (T*T)T* 5G a z) 

= 5{g a (T*T)T*Tx-x,-T*g a (TT*)G a z) 

= 5(Tg a (T*T)T*Tx-Tx,-g a (TT*)G a z) 

= 5 ((TT*g a (TT*) - I)Tx, -g a (TT*)G a z) 

= 5 (—r a (TT*)Tx, —g a (TT*)G a z) 



: [ m + r a (X)g a (X) d (F x Tx, G a z) . (21) 
Jo 



Now by hypothesis b.i) and since c\6t < X* one has that both <7 a (A) and r a (X) are nonnegative 
for all A G [0, cia]. Also, from the definitions of G a and z it follows immediately that the function 
m(A) = (F\Tx,G a z) for A G [0, cj.a] is real and non-decreasing and therefore 

I 1 r Q (X)g a (X)d{F x Tx,G a z) > 0. (22) 
J o 

On the other hand, since m(A) = (Tx, F\G a z) and F\G a = G a for every A > ciq, it follows that 
m(A) is constant for A > c%a and therefore 

[|T|[ 2 + 

r a (X)g a (X)d(F x Tx,G a z) = 0. (23) 
From ()22p and (j23|) we conclude that 

»||T|| 2 + 







r a (X)g a (X)d(F x Tx,G a z) > 0, 
which, by virtue of (|2ip . implies that 



R a Tx- x,R a (y s -Tx)^ > 0. (24) 
Hence, for every a G (0, ao), (5 > and a G a(TT*) such that cia < A* we obtain the following 
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estimate: 



R a y L 



> 



> 



1/ ' X X 

i^Q^r x x 

I^jq '-/ ' X X 

I^jq '-/ ' X X 

J&rJl 'X X 

Rfy 'J^ 'X X 



+ 



R a (y S -Tx) 2 + 2(R a Tx - x,R a (y 5 -Tx)) 



+ 5 2 \\g a (T*T)T*G & zf + 2(R a Tx - x, R a (y s - Tx)) (by ® ) 



+ 5 2 \\T*g a (TT*)Gaz\ 



(by m>) 



2 + 5 2 



+ 5' 2 



[XT* ) 2 g a (TT* ) Ga z 

T ||2 + 

\g 2 a (X)d\\F x Gaz\ 



+ 5 2 r a Xg 2 a (X)d\\F x G a z\\ 2 . 

J a 



(25) 



We now consider two different cases for a G (0, «o)- 

Case I : a < a. Since c\a < X* and c\ > 1, it follows from hypothesis b.v) that 
g a (A) > 3«(cia) > 5 a (A*) for every AG [a, c\ a]. 



(26) 



On the other hand, from hypothesis b.i) it follows that r a (X*) < 1, which implies that A* g a (X*) > 
and therefore, g a (X*) > 0. It then follows from ([26]) that 5^, (A) > g„(ci a) for every A G [a,cia]. 
Then, 



f 1 A^(A)d||F A G s z| 

J a 



2 \ - 1l -\ 

> ag a (cxa) 



ci a 



d\\F x Gaz\\ 



ag 2 a (c x a) ( \\F Cl aGaz\\ 2 - \\F & Gaz\\ 2 



agl(ci a) \\Gaz\ 
«5a( c i a), 



(27) 



where the second to last equality follows from the definition of G& and the spectral property 

-^A-^u = -?*mm{A,/x} • 

At the same time, the hypotheses b.i) and b.iii) imply that g a {X) is non-increasing as a function 
of a for each fixed A G [0, A*]. Since a < a and c\ a < A*, we then have that 



5a (ci a) > ga(ci a) 
and from hypothesis b.iv) we also have that 



5a (ci a) > > 0. 
a 



From (1281) and (l29l) we conclude that 



5^1 «)> 

V a 



2 

) ■ 



(28) 



(29) 



(30) 



Substituting (jSDJ) into ([27]) we obtain J? 1 a A 5^ (A) d \\F x G a z\\ 2 > 2f-, which, by virtue of (|25 
implies that if a < a, then II R a y S 



x\\ 2 >^. 
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Case II : a > a. In this case, it follows from hypothesis b.iii) that r^(A) > r|(A) for every 



A G (0, \\T\\ Z ]. Then, 

2 /■ll r ll a + , pir 

||i? Q Tx — x|| = / r a(A) <i H-Ea^II > / r %W d \\E\x\\ =\\R Bl Tx — x\ 
Jo Jo 



which, together with (|25p imply that H-Ray* 5 — x|| 2 > WR&Tx — ^l) 2 - 

Summarizing the results of cases I and II, we obtain that for every a G (0, ao), 5 > 0, a G a(TT*) 
with cia < ao and y* 5 as in (|20l) . there holds: 



> 



&J£, if0<a<a, 
\\RaTx — x\\ , if a < a < ao 

(72 5) 2 



> min < \\R5Tx — x\\ , ■ 



a 



(31) 



Then 



min < \\RaTx — x\\ , 



7 2 <5 



min < \\RaTx — x\ 



(72 Sf 



2 ^ \ V2 



a 



< inf 

ae(0,cro) 



(by USD) 
(since y s G B§(Tx)) 



< sup inf 

= 0(p(9" 1 (5))) for (5^0+ (by hypothesis), 
and since a = 7/(<5) solves equation (|19p. the previous inequality implies that 

72 5 



R v (S) Tx ~ x 



a 



0{p(Q- L (5))) for 5^0+, 



and therefore 



O J V (5) for ^ H 



(32) 



(33) 



p(Q-\5)) 

Now, since for every S > one has <5 = Q(Q~ 1 (S)), it follows from the definition of that 
5 = y / 9 =T (5)p(e- 1 (<5)). Then, from J33J we obtain that y 7 © -1 ^) = °(\/^)) for * -> 0+ - From 
this and (1321) we then deduce that 



0(p(7?((5))) for 5^0+, J = fjL(a), a G a(TT*), a a < a . 



(34) 



Now let L = max|Aj : Xj < Then, since A n J, 0, for any a € (0, L] there exist a unique 

n = n(a) G N such that A n +i < a < A n (note that n(a) — )• oo if and only if a — > + ). Then for 
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a G (0, L] and n = n{a) so defined we have that 

|| T ||2 + 



R a Tx-x\\ 2 = f r 2 a {X)d\\E x x\\ 2 
Jo 

r\\n 2+ 

< / r Xn (\) d\\E\x\\ , (by hypothesis b. Hi) 

Jo 



'0 

= \\R\„Tx - x\\ 2 

= 0(p 2 (X n )), (by virtue of (j34l). with 6 = p,(\ n ) ). (35) 

Also, from hypothesis c) we have that A n < cA n+ i for all n G N, and since /9 is non-decreasing and 
positive (since p G O) it follows that 

P 2 (A„) </9 2 (cA n+ i), Vn G N. (36) 

Now since c > 1 and by hypothesis a) p is of local upper type /?, there exists a positive constant d 
such that 

p{c\ n +x) < dc p p Q cA n+ i^ = dcPp(X n+1 ), Vn G N. (37) 

Hence 



p (A n ( a )) < P (cA n(a ) +1 ) (by ([36]) ) 

< dc?p (A n(a)+1 ) (by d37D ) 

< dc l3 p(a) (since A n ( Q ) +1 < a and p E O). (38) 

From (|35p and (|38p it follows that \\R a Tx — x\\ = 0(p(a)) for a — > + . Since TtT is the 
projection on AA(T)-'- = X (since T is invertible), we have that x = T^Tx = T^y. Then 
||(i? Q - Tt)y|| = 0(p(a)) for a 0+. Finally, Theorem EH implies that T*y = x G K(s(T*T)). 
This concludes the proof of the Lemma. □ 



Remark 3.7. Note that since sup inf ||ii Q ,?/' 5 — xll < £\°n Ax, 5), hypothesis U8\) of the 
preceding Lemma holds if £^ }(x,5) = 0(p(@~ 1 (5))) for 5 — > + . 



Having stated and proved the previous three lemmas, we are now ready to prove Theorem 13.31 
Proof of Theorem \3.5H As in Lemma [3. 61 without loss of generality we may assume that «o < t - - 

We will show that ip(x,5) = p o @ _1 (5) for x G X s p and 5 G (0, 0(ao)), is saturation function of 

{Ra}ae(o,a ) on -^ Sp ( see Definition 12. 6p . 

First we note that since {g a } satisfies (H4) and p is continuous (p being of local upper type), 

by virtue of Lemma 13. II one has that ip G Ux s p(£{°r })• Next we will show that tp satisfies the SI 

condition for saturation on X Sp . Suppose that it is not true, i.e. that there exist x* G X, x* ^ 

and x G X Sp such that limsup {R l) s \ ' = 0. Then £)°n Ax* ,5) = o(i/j(x, 8)) as S — > + and from 
Lemma 13.51 1) it follows that there exists an a-priori parameter choice rule a(5) such that 



sup 

y s eB s (Tx*) 



R&(5)y 5 -x* =o(i(j(x,5)) for<5^0 + . (39) 
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On the other hand, from hypothesis c) it follows that there exists a G a(TT*) such that 
< c\a < ao and h(a) < ||T|| 2 . Now define 



- - a 1 / 2 
5 = 5(a) = \\RaTx* — x*\ 



n 



1/2 



72 72 

:<5 



|ra(T*T)x*| 



and for 5 > 0, 

y d =Tx* -5GaZ, (40) 

as in (|20p . Following the same steps as in the proof of Lemma 13.61 we obtain as in (|3ip that for 
every a G (0, ao), 5 > 0, a G a(TT*) with cia < ao and /i(a) < ||T|| 2 , and y s as in fliP]) , there 
holds: 

_.||2 (72 <5) 2 





2 f 




> mm < 



o 



(41) 



Then for 5 > such that G (0, ao), 
min <! \\Rr,Tx* — a?* II 



= 


min / 


< 


inf 


ae(0,ao) 


< 


R&(s)y 


< 


sup 



* 1 1 2 



(72 <*) 2 



2 1 \ 1/2 



a 



RaV-X* 



R. 



&{S)V 



(by <gU)) 
(since a(<5) G (0, ao)) 
(since G Bs(Tx*)) 



y 6 eB s (Tx*) 

= o(p(e- 1 (^))) for (5^0+ (by®), 
and since a = t/(<5) solves equation (|19p with x = x*, the previous inequality implies that 



2?_ = ( p ( e -i(j))) for 5^o + . 
Va 



R v (S) Tx * ~ x * 

Following analogous steps as in the proof of Lemma 13, 61 we obtain, as in (|34p . that 



R n {5) Tx * ~ x * 



o(p(r](5))) for (5 — )• + , 5 = n(a), a G a(TT*), c\ a < ao, h(a) < \\T\\ . 



(42) 



Now, 



imi 2 + 



*i|2 



> 





h(a) 



rl(X)d\\E x x 



rl{X)d\\E x x*\\ 2 , (since < h(a) < \\T\\ 2 ) 



> 7V(«) / S - 2 (A)d||i? A x* 

4(a) 



(43) 



where the last inequality follows from the fact that (p, s,,) is an order-source pair for {g a } (with 7 
the constant in (HJ) ). Since r](6) = a and 5 — > + if and only if a — > + , (|42p and (|43p imply that 

imi 2 + 

s7 2 (A)d|| J B A x*|| =o(l) for a -»■ 0+ 



h(a) 
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and therefore ||s~ 1 (T*T)x*|| = 0. Then x* = 0, contradicting the fact that x* ^ 0. Hence, 
tp(x,5) = p(&~ 1 (5)) satisfies condition SI on X Sp . 

Also, since if> is trivially invariant over X Sp , ip does not depend on x. Thus, it satisfies condition 

S2. 

It only remains to be proved that if) satisfies condition S3 on X Sp . Suppose that is not the case. 
Then there must exist a set M, X s " C m C X \ {0} and if) G Um(£¥£ x) such that ip \x s p = if> and 
$ satisfies SI and S2 on M. Let x* £ M\X Sp . Since $ G |^ a} ) we have that 



-tot 



(44) 



_ {x*},X Sp _ 

Also, since ip is invariant over M we have that if) ^ ip, and since ?/> coincides with ip on X Sp , 

_ {x*},X s P {x*},X a P 

it follows that if) ■< ip. This, together with (144ft implies that £ fp i ^ "0 and therefore 



^. This, together with (1341 implies that 
for every x G X s ", ^ } (x*, 5) = 0(ip(x,5)) as <5 -»■ 0+, that is, 5{^}(x*, 5) = 0(p(G- 1 (<5))) as 
(5 — t- + . Lemma 13.51 then implies that there exists an admissible a-priori parameter choice rule 
a(5) such that 



sup 



and therefore 



y s £B s {Tx*) 

sup 



Rf 



(8)y 



y*>eB s {Tx*) 



inf 

a£(0,ao) 



0(p(e _1 (<$))) as 5 -> 0^ 



0(/o(e -1 (<*))) as<5^0 H 



Hence, by virtue of Lemma [331 x* G TZ(s p (T*T)) and since x* / 0, we have that x* G TZ(s p (T*T)) \ 
{0} = X Sp which contradicts our original assumption. This concludes the proof of the Theorem 

□ 



4 Examples 



Although the main results of this article are very theoretical in nature, we provide below two 
examples of regularization methods with optimal qualification which do possess saturation. In 
both cases the saturation function and saturation set are found. 

Example 4.1. The family of Tikhonov- Phillips regularization operators {Ra} a e(o,a ) where R a = 
g a (T*T)T* with <? a (A) = has optimal qualification p(a) = a (f2f). It can be easily checked that 
p is of local upper type 1, s p (X) = A G S and {ga} a e(o,ao) satisfies all hypotheses of the Theorem 
E3 Therefore, the function if)(x,6) = p(e _1 (5)) = <5§ defined for x G X Sp = K(T*T) \ {0} and 
5 G I 0, olq I is saturation function of {R a }ae{0,a ) 071 X Sp . 



Example 4.2. Given k G M. + , for a > let 



A 

A J 

A 



A _' 

A 



+ 



Afc+i ' 



for < A < a, 
for a < A < 3a, 
for A > 3a, 
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and g k (X) = j - a k VX - u k a (X) for A > 0, and for A 

family {g a } a e(o,a ) is a SRM (J^). 
Now, defining 



<(A) 



A_ 

e 



+ (x)' 



define g k (0) 

for < A < a, 
for a < A < 3a, 
for A > 3a, 



lim g*(A) 
A-5-0+ 



-J=. T/ie 



then s p G 5 



z£ follows that r k (X) = 1 - Xg k (X) = a fc A§ + f„(A). // p(a) = a fc i/ien s p (X) = X k 
and s p satisfies Also, it can be show that p and s p verify ^ with 7 = 1 and h(a) = 3a. From 
Theorem \2.11\ it then follows that p(a) = a k is optimal qualification of {g a }. 

On the other hand, for k > 1 and a > 0, the function g k (X) is non-increasing. Thus, hypothesis 
b.v) of Theorem ] 3. 3\ holds and = UsQOIIjx, = 9a(0) = which implies immediately that also 
hypothesis H4 is verified. From now on we shall assume k > 1. 

It can be easily checked that p is of local upper type k and {g a }a£(o,a ) satisfies all hypotheses 

2k 

of the Theorem 13.31 Therefore, the function ip(x,5) = = 5 2k + 1 defined for x £ X Sp = 



K((T*T) k ) \ {0} andSe 0,a 



is saturation function of {R a } a e(o,a ) 071 X Sp . 



5 Conclusions 

In this article families of real functions {g a } denning a spectral regularization methods with optimal 
qualification were considered. Sufficient conditions on the family and on the optimal qualification 
guaranteeing the existence of saturation were found. Appropriate characterizations of both the 
saturation function and the saturation set were given and two examples were provided. 
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